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Abstract 

In this work, we study a new model of defect memory cells, called partially stuck-at memory cells, which is motivated by 
the behavior of multi-level cells in non-volatile memories such as flash memories and phase change memories. If a cell can store 
the q levels 0,1,..., g — 1, we say that it is partially stuck-at level s, where 1 < s < g — 1, if it can only store values which are 
at least s. We follow the common setup where the encoder knows the positions and levels of the partially stuck-at cells whereas 
the decoder does not. 

Our main contribution in the paper is the study of codes for masking u partially stuck-at cells. We first derive lower and 
upper bounds on the redundancy of such codes. The upper bounds are based on two trivial constructions. We then present three 
code constructions over an alphabet of size q, by first considering the case where the cells are partially stuck-at level s = 1. The 
first construction works for u < q and is asymptotically optimal if u -f 1 divides q. The second construction uses the reduced row 
Echelon form of matrices to generate codes for the case u > q, and the third construction solves the case of arbitrary u by using 
codes which mask binary stuck-at cells. We then show how to generalize all constructions to arbitrary stuck levels. Furthermore, 
we study the dual defect model in which cells cannot reach higher levels, and show that codes for partially stuck-at cells can be 
used to mask this type of defects as well. Lastly, we analyze the capacity of the partially stuck-at memory channel and study how 
far our constructions are from the capacity. 


Index Terms 

(partially) stuck-at cells, defect cells, flash memories, phase change memories 


I. Introduction 

Non-volatile memories such as flash memories and phase change memories (PCMs) have paved their way to be a dominant 
memory solution for a wide range of applications, from consumer electronics to solid state drives. The rapid increase in 
the capacity of these memories along with the introduction of multi-level technologies have significantly reduced their cost. 
However, at the same time, their radically degraded reliability has demanded for advanced signal processing and coding 
solutions. 

The cells of PCMs can take distinct physical states. In the simplest case, a PCM cell has two possible states, an amorphous 
state and a crystalline state. Multi-level PCM cells can be designed by using partially crystalline states 0. Failures of PCM 
cells stem from the heating and cooling processes of the cells. These processes may prevent a PCM cell to switch between its 
states and thus the cells become stuck-at 0, in), ig, 1^. Similarly, in the multi-level setup, a cell can get stuck-at one 
of the two extreme states, amorphous or crystalline. Or, alternatively, the cells cannot be programmed to a certain state, but 
can be in all other ones; for example, if a cell cannot be programmed to the amorphous state it can still be at the crystalline 
state as well as all intermediate ones. A similar phenomenon appears in flash memories. Here, the information is stored by 
electrically charging the cells with electrons in order to represent multiple levels. If charge is trapped in a cell, then its level 
can only be increased, or it may happen that due to defects, the cell can only represent some lower levels. Inspired by these 
defect models, the goal of this paper is the study of codes which mask cells that are partially stuck-at. 

In the classical version of stuck-at cells (see e.g. GD), the memory consists of n binary cells of which u are stuck-at either 
in the zero or one state. A cell is said to be stuck-at level s G {0,1} if the value of the cell cannot be changed. Therefore, 
only data can be written into the memory which matches the fixed values at the stuck-at cells. A code for stuck-at cells maps 
message vectors on codewords which mask the stuck-at cells, i.e., the values of each codeword at the stuck positions coincide 
with their stuck level. The encoder knows the locations and values of the stuck-at cells, while the decoder does not. Hence, the 
task of the decoder is to reconstruct the message given only the codeword. The challenge in this defect model is to construct 
schemes where a large number of messages can be encoded and successfully decoded. If u cells are stuck-at, then it is not 
possible to encode more than n — u bits, and thus the problem is to design codes with redundancy close to u. The same 
problem is relevant for the non-binary setup of this model, where the cells can be stuck at any level. 

The study of codes for memories with stuck-at cells, also known as memories with defects, takes a while back to the 1970s. 
To the best of our knowledge, the problem was first studied in 1974 by Kuznetsov and Tsybakov Og. Since then, several 
more papers have appeared, e.g. 0 , 0 , 0 , 0 , fig, ig, Gg, gg-ig. The main goal in all these works was to And 
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constructions of codes which mask a fixed number of stuck-at cells and correct another fixed number of additional random 
errors. Recently, the connection between memories with stuck-at cells and the failure models of PCM cells has attracted a 
renewed attention to this prior work. Several more code constructions as well as efficient encoding and decoding algorithms 
for the earlier constructions were studied; see e.g. §, |Tg, |ig, |T3, 

This paper studies codes which mask cells that are partially stuck-at. We assume that cells can have one of the q levels 
0,1,..., <7 — 1. Then, it is said that a cell is partially stuck-at level s, where 1 < s < g — 1, if it can only store values which 
are greater than or equal to s. In this work, we provide upper and lower bounds on the redundancy and give several code 
constructions with small redundancy in order to mask partially stuck-at cells. To facilitate the explanations, our constructions 
are hrst given for the case s = 1, and later generalized to arbitrary levels. 

In the hrst part of the paper, we derive lower and upper bounds on the redundancy of codes that mask partially stuck-at 
memory cells. The hrst lower bound is based on the number of states that each partially stuck-at cell can attain. For the case 
where all cells are partially stuck-at the same level s, we also derive an improved lower bound. Further, codes which mask 
any number of partially stuck-at cells can simply be constructed by using only the levels max^ 1 in each cell. 

Alternatively, codes which mask u stuck-at cells (not partially) can be used to mask u partially stuck-at cells. Thus, these two 
schemes provide an upper bound on the minimum redundancy of codes that is necessary to mask u partially stuck-at cells. 

In the course of this paper, we provide several code conshTictions and analyze how far they are from our lower and upper 
bounds on the redundancy. In particular, for u < q, we hrst show that one redundancy symbol is sufficient to mask all partially 
stuck-at cells. Further, an improvement of this construction turns out to be asymptotically optimal in terms of the redundancy. 
Our second construction uses the parity-check matrix of q-ary error-correcting codes. The third construction uses binary codes 
which mask (usual) stuck-at cells. We also show how the codes we propose in the paper can be used for the dual defect model 
in which cells cannot reach higher levels. Lastly, we analyze the capacity of the partially stuck-at memory channel and study 
how far our constructions are from the capacity. 

The rest of the paper is organized as follows. In Section]^ we introduce notations and formally dehne the model of partially 


stuck-at cells studied in this paper. Our lower and upper bounds on the redundancy are presented in Section III In Section IV 
we propose codes along with encoding and decoding algorithms for the case rt < g. In Section |V] we give a construction 
based on g-ary codes and in Section VI we show a more general solution by using codes which mask binary stuck-at cells. 
Section VII generalizes the previous constructions to cells which are partially stuck-at arbitrary (possibly different) levels 
sO) sij • ■ •) Su-i- The (dual) problem of codes for unreachable levels is studied in Section |VIII and Section analyzes the 
capacity of the partially stuck-at channel. Finally, Section concludes this paper. 


II. Definitions and Preliminaries 

A. Notations 

In this section, we formally dehne the models of (partially) stuck-at cells studied in this paper and introduce the notations 
and tools we will use in the sequel. In general, for positive integers a, b, we denote by [a] the set of integers {0,1,..., a — 1} 
and [a, 5 — 1] = {a, a -f 1,..., 6 — 1}. Vectors and matrices are denoted by lowercase and uppercase boldface letters, e.g. a 
and A, and are indexed starting from 0. The all-zero and all-one vectors of length n are denoted by 0„ and 1„. Further, for 
a prime power g, denotes the hnite held of order g. 

We consider n memory cells with g levels, i.e., they are assumed to represent g-ary symbols having values belonging to the 
set [g]. We can therefore represent the memory cells as a vector in [g]". 

In the classical model of stuck-at cells, a cell is said to be stuck-at level s G [g] if it can store only the value s. In our 
new model of partially stuck-at cells, a cell is partially stuck-at level s G [g] if it can store only values which are at least s. 
In the hrst part of this work, when studying partially stuck-at cells, we only consider s = 1 and we call such cells partially 
stuck-at-l. Throughout this paper, we also use the notation partially stuck-at-s, when one or several cells are partially stuck-at 
level s. Lastly, in the most general case, u cells are partially stuck-at-s, where s = (sq, si,..., s^-i) is a vector and contains 
the different stuck levels Sq, Si,..., s„_i of the u defect cells. 


B. Definitions for (Partially) Stuck-at Cells 

We use the notation {n,M)q to indicate a coding scheme to encode M messages into vectors of length n over the alphabet 
[g]. Its redundancy is denoted by r = n — log^ M. A linear code over [g] (in which case g is a power of a prime and [g] 
corresponds to the hnite held of order g), will be denoted by [n, k]q, where k is its dimension and its redundancy is 
r = n — k. Whenever we speak about a linear [n, k, d]q code, then d refers to the minimum Hamming distance of an [n, k]q 
code. We also denote by pq (n, d) the smallest (known) redundancy of any linear code of length n and minimum Hamming 
distance d over F^. For the purpose of the analysis and the simplicity of notations in the paper, we let pq {n,d) = oo in case 
g is not a power of a prime. 

Codes for (partially) stuck-at cells are dehned as follows. 

Dehnition 1 (Codes for (Partially) Stuck-at Cells) We define the following code properties: 
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1) An (n,M)g u-stuck-at-masking code (u-SMC) C is a coding scheme with encoder £ and decoder T). The input to the 

encoder £ is the set of locations {(/)o, , fu-i} C [n], the stuck levels sq, si,..., Su_i € [g] of some u < n stuck-at 

cells and a message m € [M], Its output is a vector g [g]” which matches the values of the u stuck-at cells, i.e., 

= Si, Vi e {fo, • ■ ■, 

and its decoded value is m, that is = m. 

2) An {n,M)q {u,s)-partially-stuck-at-masking code ({u,s)-PSMC) C is a coding scheme with encoder £ and decoder 

T). The input to the encoder £ is the set of locations C [n], the partially stuck levels s = 

(sO) Si) • ■ •) Su-i) V [1 j9 ~ 1]“ of some u < n partially stuck-at cells and a message m g [M]. Its output is a 

vector y^™) g [o']" which masks the values of the u partially stuck-at cells, i.e., 

> Si, Vi g 

and its decoded value is m, that is = m. 

Notice that in contrast to classical error-correcting codes, (P)SMCs are not just a set of codewords, but also an explicit 
coding scheme with encoder and decoder. Further, the partially stuck levels stored in s have to be known to the decoder of a 
PSMC, whereas the decoders of SMCs are independent of the stuck levels. Clearly, a (m,s)-PSMC is also a (u', s')-PSMC, 
where u' < u and s' is a subvector of s of length u'. 

Whenever we speak about [u, s)-PSMCs (i.e., s is a scalar), we refer to a code that masks at most u partially-stuck-at-s 
cells and when simply we speak about a m-PSMC, we mean a code which masks at most u partially-stuck-at-1 cells. 

In the design of (P)SMCs, the goal is therefore to minimize the redundancy n — log^ M for hxed values u and s, while 

providing efficient encoding and decoding algorithms. For positive integers n, q, u, where u <n, and a vector s g [1, q — 1]“, 
we denote by {n, u, s) the minimum redundancy of a {u, s)-PSMC over [g]. Note that throughout this paper we only consider 
the problem of masking partially stuck-at cells, without correcting additional (random) errors as e.g. in Q for stuck-at cells. 

C. Codes for Stuck-at Cells 

Codes for masking stuck-at cells were studied before and one such construction is stated in the following theorem; see 
e.g. 0. We show the proof of this theorem, which includes the encoding and decoding of SMCs, for the completeness of 
results in this paper and since our encoding and decoding algorithms use similar ideas. 

Theorem 1 (Masking Stuck-At Cells, 0) Let C be an [n, k, (I\q code with minimum distance d>u-\-l, where q is a prime 
power. Then, there exists a u-SMC with redundancy r = n — k. 

Proof: The proof is based on explicitly showing in the following two algorithms how to use the error-correcting code C 
to mask stuck-at cells. We assume that H is a systematic {n — k) x n parity-check matrix of the code C which is known to 
both, encoder and decoder. 

Algorithm [T] describes the encoding process. We have to prove that in Step 2, a vector z always exists such that the encoded 
vector y masks the u stuck-at cells. Dehne x = {xo,xi,..., Xn-i) = z • H. We have to fulhll the following u equations: 

= Si, Vi g [m]. 

Denote by H„ the u columns of H indexed by fo,..., fu-i- Then, we have to hnd z such that 

z ■ Hu — (sq , Si ..., Su—\ ). 

This is a heterogeneous linear system of equations with at most u<d—\<n — k linearly independent equations and n — k 
unknowns (the elements of z). Therefore, there is at least one solution for the vector z such that y masks the stuck-at cells. 
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Algorithm 1. 

ENCODINGSTUCK(m; (^o, 01, ■ • • , 0n-i; Sq, Si, , Su i) 

Input: • message: m = {mo, mi, ... ,mk-i) £ 

• positions of stuck-at cells: {0o, 0i, ■ • •, 4’u-i} ^ H 

• levels of stuck-at cells: sq, Si,..., s„_i £ [g] 

1 w = {wo,wi,... ,w„-i) <- . ..mk-i) 

2 Find z £ such that y <— w -|- z ■ H masks the stuck-at cell^ 

Output: vector y with y^. = Si, Vi £ {0o, ■ • •, 4>u-i} 


"We assume here and in the rest of the paper that there is a one-to-one mapping F : [q] 

Fq so arithmetic operations like multiplication and addition in w -|- z • H are defined as 
F(w) + F{z) ■ H. 


Algorithm 1^ describes the decoding process. 


Algorithm 2. DECODiNGSTUCK(y) 

Input: • stored vector: y = 

^ {yo,yi,---,yn-i) £ [g]" 

1 z ^ (?/o,t/i,.. .,y„-k-i) 


2 W = {Wo,Wl, . . .,Wn-l) ^ 

y - z H 

3 in ^ {w„-k,'Wn-k+l, • . ■, 

W„-i) 

Output: message vector fn 

e[q]’^ 


We have to prove that rh = m. Note that H is a systematic parity-check matrix and therefore, the first n — k positions of 
the output vector y of Algorithm [T] (which is at the same time the input of Algorithm equal z. Therefore, in Step 1 in 
Algorithm]^ we obtain z = z and thus, in Step 2, w = y — z H = w and in Step 3, in = m. ■ 

It is not completely known whether the scheme of Theorem [T] is optimal with respect to its achieved redundancy. However, 
the redundancy of such a code has to be at least u since there are u stuck-at cells that cannot store information. 

Let us illustrate Theorem [T] (and Algorithms [T] and with an example. 

Example 1 Let u = 2, g = 3 and n = 5. Therefore, we need a ternary code of minimum distance at least rt -I- 1 = 3. The 
largest such code is a [5, 2, 3)3 code (see j^) with a systematic parity-check matrix 

/I 0 0 1 0\ 

H= 0 1 0 1 1 . 

\0 0 1 0 1/ 

We will show how to construct a (5,3^ = 9)3 2-SMC which masks any u' <u = 2 stuck-at cells. 

For the encoding, we proceed as in Algorithm^ Let m = (mo, mi) = (2, 1) be the information we want to store and assume 
that the cells at positions fo = 0 and 0i = 4 are stuck-at sq = 1 <^nd si = 2. Further, let w = (0, 0, 0, mg, mi) = (0, 0, 0, 2, 1). 
Given w, fo, 0i and sg, Si, our goal is to find a vector x £ [3]^ such that y = (w -f x) mod 3 matches the partially stuck-at 
cells and yet the information stored in m can be reconstructed from y. 

We use z = (1, 0,1). Then, x = z • H = (1,0,1,1,1) and y = w -|- x = (1,0,1,0, 2) which masks the stuck-at cells. 

To reconstruct w, given y, we notice that {yo,yi,y 2 ) = z = (1,0,1) and we can simply calculate y — (t/o,yi,j/ 2 ) • H to 
obtain w and therefore m. 

Thus, the required redundancy for masking u = 2 stuck-at cells with Theorem^is r = 3 (the first three symbols). 

III. Bounds on the Redundancy 

For deriving upper and lower bounds on the minimum redundancy of PSMCs, we assume the most general case of {u, s)- 
PSMCs, where s = (sg, si,..., s„_i) £ [1, g — !]“• Hence, when a cell at position is partially stuck-at level Si, it can only 
store the values Si -|- 1 ,..., g — 1}. 
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Theorem 2 (Bounds on the Redundancy) For any number of u < n partially stuck-at cells and any levels s 
[l,g — 1 ]^, the value of the minimum redundancy Vq (n, w,s) to mask these cells satisfies 


/u-l 


-log, 


,i=0 


< rq (n,M,s) 


< min |n • (l - log^ {q - maxjsj)), Pq (n,M + 1 )| . 


^1; • • ■ 5 l) € 


Proof: Let us start with the lower bound. The n — u cells, which are not partially stuck-at, can each carry a g-ary 
information symbol and the u partially stuck-at cells can still represent q — Si possible values (all values except for [s^]). 
Hence, we can store at most M < nfcro^('? ~ 9 ‘^y vectors and the code redundancy satishes 

C u-l \ /u-1 

^n-u I ^ I (g - S*) 

i=0 / \i=0 

Second, we prove the upper bound. A trivial construction to mask any u < n partially stuck-at cells is to use only the values 
maxi{si},..., g — 1 as possible symbols in any cell. Any cell therefore stores logg(g — maxjjsi}) g-ary information symbols. 
The achieved redundancy is 

^ - logg ((g - max{si})") = n(l - logq(g - max{sj)), 
and therefore (n, u, s) < n(l — \ogq{q — maxijsi})). 

Furthermore, every m-SMC can also be used as (m,s)-PSMC since the SMC restricts the values of the stuck-at cells more 
than the PSMC. With Theorem the redundancy of an SMC is pq{n,u+ 1), which provides another upper bound on the 
value of Tq (n, u,s). ■ 

Note that pq {n,u+ 1) > u (by the Singleton bound). 

The bounds from Theorem will serve as a reference for our constructions, as we should ensure to construct codes with 
smaller redundancy than the upper bound and study how far their redundancy is from the lower bound. 

For the special case of partially stuck-at-1 cells, we obtain the following bounds on the redundancy Vq {n, u, 1) of a u-PSMC 
for all positive integers n, q, u where u < n: 

w(l - log,(g- 1 )) 

<rq{n,u,l) ( 1 ) 

< min{n (l - logq{q - 1 )) , Pq {n,u+l)} . 

For partially stuck-at-s cells, we further improve the lower bound on the redundancy in the next theorem. 



Theorem 3 (Improved Lower Bound) For any {n,M)q (u, s)-PSMC, we have M < therefore 

rq (n, u, s) > logq{u -f 1) - logg (1 -f u(l - s/g)”). 


Proof: Assume that there exists an {n,M)q (u, s)-PSMC, and let £, V be its encoder, decoder, respectively. In this case 
we assume that the encoder’s input is a message m G \M] and a set of indices U C [n], |?7| < u, of the locations of the cells 
which are partially stuck-at level s. We will show that M < J ■ For every m G [M], let 

= {y € [g]” | V{y) = m}. 


For every m G \M] such that 'D~^{m) n ([g] \ [s])" = 0, we have that \'D~^{m)\ > u -f 1. To see that, assume on the 
contrary that \'D~^{m)\ = u (the same proof holds if \'D~^{m)\ < u), so we can write 'D~^{m) = {yo,yi, • ■ ■ ,y«-i}, while 
Yj ^ ([g] \ [s])" for j G [u]. For j G [m], let ij G [n] be such that yyi. < s, and U = Then, £{m, U) y^ 

for all j G [u] (where the message m and the positions set (7 are the input to the encoder £) and thus > u -f 1, in 

contradiction. 

Since there are (q — s)" vectors all with values at least s, there are M — (q — s)" vectors of the described type above where for 
each such vector there exists a message m where |I?“^(m)| > u+1. Therefore, we get that (g— s)"-|-(m-|- 1)(M—(g—s)”) < g", 
or 


M < 


g” -I- u(q — s)" 
M -I- 1 


rq (n, u,s)>n- log 


g” -f u{q — sf 
u+1 


= log^(M-f l)-log, (l-fM(l 


-s/g)”)- 


We also conclude that 
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For u = 1, we obtain from Theorem 

rq (n, 1, s) > logg 2 - log^ (l + (1 - s/q)"). 

For s = (so, si, • ■ ■, s„_i) and Smax = maxig[„]{si} and Smin = minjg[„]{si}, we have 

rq (n, u, Smax) > rq (n, u, s) > rq (n, U, Smin) , (2) 

so we can always use rq (n, rt, 1 ) as a lower bound for partially stuck-at-so, si,..., s„_i cells. 

Examples and show cases where the lower bound from Theorem is better than the lower bound from ([T]). 

IV. A Construction for Partially Stuck-at Level s = 1 Cells eor u < q 
A. Code Construction 

In this section, we show a simple construction of u-PSMCs for masking any u < q partially stuck-at-1 cells, which works 
for any q (not necessarily a prime power). Let us illustrate the idea of this construction with an example. 

Example 2 Let u = 2, q = 3 and n = 5. We will show how to construct a (5, 3^ = 81)3 u-PSMC. 

Let m = (mo, m. 1 ,1712, TO 3 ) = (2,0,1,0) be the information we want to store and assume that the two cells at positions 
00 = 1 and 01 = 2 are partially stuck-at-1. We set w = (0, mo, mi, m 2 , m 3 ) = (0, 2,0,1,0). Given w, 0o and 0i, our goal 
is to find a vector x such that y = (w -f x) mod 3 masks the partially stuck-at-1 cells and yet the information stored in m 
can be reconstructed from y. 

We use X = z • I 5 , for some z € [3]. Since Wi = 2, we can choose any value from [3] for z except for 1, and since W2 = 0, 
we can choose any value but 0. Thus, we choose z = 2 and encode the vector y fo he y = w -f 2 • I 5 = (2,1, 2,0, 2), which 
masks the two partially stuck-at-1 cells. 

To reconstruct w, given y, notice that i/q = z = 2 and we can simply calculate y — i/o ' I 5 to obtain w and therefore m. 
Thus, the required redundancy for masking u = 2 partially stuck-at-1 cells is r = 1 (the first symbol). The lower bound 
from o is 2 • (1 — log 3 2) = 0.738, the lower bound from Theorem^gives 0.787 (and therefore improves upon the bound 
from Theorem^ and the upper bound is min{5 • (1 — log 3 2), (5,3) = 3} = 1.845, where the second part was shown in 

Example 

The following theorem shows that it is possible to construct a m-PSMC with this strategy for any u < q. 

Theorem 4 (Construction I for u < q) If u < q and u < n, then for all n, there exists an {n,M = q'^~^)q u-PSMC with 
redundancy of one symbol. 

Proof: As in the proof of Theorem we give the explicit encoding and decoding algorithms. 

The encoding is shown in Algorithm ^ Let 0o, 0i,..., 4>u-i be the positions of some u partially stuck-at-1 cells and let 
m = (mo, mi,..., mn- 2 ) G [ 9 ]””^ be the message to be written to the memory w. We hrst set w = (0, mo, mi,..., m„_ 2 ). 
Since u < q, there exists at least one value v G [g] such that f=- v. Choose z = q — v = —v mod q and 

therefore, w,p. -\- z = — v) mod g ^ 0. Thus, the output vector y masks all u partially stuck-at-1 cells. 


Algorithm 3 . ENCODlNG-l(m; 0o, 0i,... 

5 ‘^'U —1) 

Input: • message: m = (mg,mi,... ,m 

n-2) G [g]"-i 

• positions of partially stuck-at-1 

cells: 

{ 00 , 01 , ■ • ■ , 0u-i} G [n] 


1 w = {woyWi,... ,Wn-i) -ir- (0,mo,mi,, 

. ..mn-2) 

2 Set V e [g] such that v ^ , Wij ,^,..., 


3 z q — V 


4 y (w -F z • 1 „) mod q 


Output: vector y with y^j,. > 1, Vi e [u] 



The decoding algorithm is shown in Algorithm and it simply uses the fact that yo is used to store the value of z. Thus, 
m = m. 
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Algorithm 4. DECODiNG-l(y) 

Input : • stored vector: y = (t/q, 2/1, ■ • ■, 2 /n-i) e [g]" 

1 2/0 

2 in ^ ((2/1,2/2, ■ • -,2/71-1) - In) mod q 
Output: message vector fn 6 


Lastly, since we need only one symbol to store the value of z = g — u in the first cell, the redundancy is one. ■ 

This principle works for any n since 1„ always exists. Further, q does not have to be a prime power and we can use this 
strategy even if [g] does not constitute a finite field. 

Theorem 1^ provides a significant improvement compared to codes for the (stronger) model of usual stuck-at cells, where 
the required redundancy is pq (n, u + 1) > it. In order to compare our result to the first term in the upper bound from Q, we 
use the approximation ln(g) — ln(g — 1 ) « 1 /g for g large enough and thus. 


l-logg(g- 1) 


1 

glng' 


Hence, for n> glng, the construction from Theorem [^achieves smaller redundancy than the upper bound from (0. However, 
for u < q and n large enough the lower bound on the redundancy from Theorem is log^(it + 1) < 1. This suggests that 
codes with better redundancy might exist, as we shall see in the next subsection. 


B. Improvement of Construction I 

In this subsection, we show how to improve Construction I from Theorem and therefore, how to reduce the required 
redundancy. Let us first show an example of this modification. 


Example 3 Let u = 2 and g = 6 . Then, with the same principle as in Algorithm^and z G [3], we can mask any two partially 
stuck-at-1 cells with one redundancy symbol. The important observation here is that z can always be chosen from a small 
subset of [g]. Assume, the first cell stores the redundancy, namely yo = 2 , and takes therefore only three out of six possible 
values. We can store additional information in this cell e.g. as follows: 0 is represented by 0 or 3; 1 is represented by 1 or 4; 
and 2 is represented by 2 or 5. By choosing e.g. between storing 1 or 4, we store additional information in the redundancy cell. 
Thus, the information stored (in terms of q-ary symbols) increases by logg(6/3) and the required redundancy reduces from 
one symbol to 1 — logg(2) « 0.613 symbols while the lower bound from 0 gives « 0.204. The lower bound from Theorem^ 
gives 0.284/or n = 5, and 0.457 for n = 10. For n —/■ cx), the lower bound from Theorem^reaches 0.613 which is exactly 
the redundancy achieved by our construction. 

In general, assume that u < q, then there is some v G [u + 1] such that f v. Hence, if u is 

significantly smaller than g, then there is more than one value to choose the value of v from and the redundancy decreases by 
^ogqi[q/{u + 1)J) symbols. 

Thus, with Theorem and the previous considerations, we obtain the following result. 


Theorem 5 (Construction IB) If u < q and u < n, then for all n, there exists a u-PSMC over [g] of length n and redundancy 

q 


r = 1 - log„ 


u + 1 


Proof: In order to prove the statement, we modify Algorithm to obtain an encoding procedure for the improved 
construction from Theorem |5] 











Algorithm 5. ENCODlNG-lB(m; m'; (^oi 0ii • ■ ■ i 0u-i) 

Input: • message: m = (mo,mi,... ,m„_ 2 ) £ 

• additional message: m' £ 

• positions of stuck-at-1 cells: {(^Oi 4>It ■ ■ j 4>u-i] ^ H 

1 w = (u;o,?ni,..., w„_i) ^ (0,mo,mi,... ,m„_ 2 ) 

2 Set D £ [it + 1] such that 

V ^ {w^g mod (m + 1),..., mod (u + 1)} 

3 z q — V — m'(u + 1) 

4 y ^ (w + 2: • 1„) mod q 

Output: vector y with > 1, Vi £ [it] 


The encoding algorithm is a generalization of Algorithm]^ We will prove that the output vector y masks the partially stuck-at-1 
cells. In Step 2, we can always find a value v G [m +1] as required since the set {ic^o mod (it -f 1),..., mod (it -|- 1)} 

has cardinality it and there are it -I- 1 possible values to choose from. Note that in Step 3, z £ [g] since v G [it -I- 1] and 
m' {u -I- 1) € [<7 — It]. In Step 4, we obtain: 

y^f,. = {wcj,^ — V — m {u + 1)) mod q. 

Since v ^ w^. mod (it -I- 1) from Step 2, we conclude that ^ 0, for all i G [it], and the partially smck-at-1 positions are 
masked. 

The decoding algorithm has to guarantee that we can recover m and m' and is shown in Algorithm Here, we notice 
that yQ = z = q — V — m'{u -I- 1) from the encoding step and therefore, in Step I, 'z = z and in Step 2, v = v. Solving 
1/0 = q — V — m'{u + 1) for m' shows that in Step 3, the result of the fraction is always an integer and that m' = m'. Since 
z = z, it follows that m = m in Step 4. 


Algorithm 6. DECODiNG-lB(y) 

Input : • stored vector: y = (i/o, Vi, ■ • ■, Vn-i) £ [</]" 

1 z-i-yo 

2 u (o' — z) mod (u -b 1) 

^ q-z-v 

3 m' < - 

li -b 1 

4 in ^ ((i/i,y2, ■ • -,2/71-1) - I71-1) mod q 

Output: message vector fh £ [g]"“^ 

additional message m' 


Clearly, for u < q, the redundancy is r < 1. The following lemma shows that this construction is asymptotically optimal. 

Theorem 6 (Optimality of Theorem]^ If [u + 1) divides q, the u-PSMC from Theorem^is asymptotically optimal in terms 
of the redundancy. 

Proof: If (M-bl)|(/, then the redundancy from Theoremlsjis r = log^(i(-bl). The lower bound on the minimum redundancy 
from Theorem^is (n, u, 1) = logg(it -b 1) — log^ (l -b 11(1 — l/i/)"). The difference between both is 

A,(n, u) = r-rq (n, 11,1) = log^ (l -b ii(l - 1/g)”) - 

For n ^ 00 and since (1 — 1/q) < 1, this value approaches 

log, (1 + 12(1 - 1 / 9 )") ^ log, (1 + 0) = 0. 

Thus, the construction is asymptotically optimal. ■ 
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V. Constructions Using q-ary Codes for Partially Stuck-at Level s = 1 Cells 

For M > <7, it is not always possible to construct w-PSMCs with the strategy from Theorem]^ (and Algorithms |^|^. Therefore, 
this section provides a construction which works well for u > g and can be seen as a generalization of Construction I (instead 
of the all-one vector, we use a parity-check matrix). Let us start with a general statement for any u and any prime power q. 

Theorem 7 Let q be a prime power and let a k x n matrix H = over be given. If the reduced row Echelon 

(RRE) form of any kxu submatrix (denoted by has the following form (up to column permutations 

RRE(H(“)) = (3) 

. . . o 
... o 

o ... ... o 

\ U 1 . 

<9-1 

where • has to be a non-zero element from and o is any element from Fg, then, there exists a u-PSMC over Fg of length n 
and redundancy r = k. 

Proof: Assume w.l.o.g. that the partially stuck-at-1 positions are [w]. As before, if q is a prime power, we fix a mapping 

from the elements of the extension field Fg to the set of integers [g]. The encoding and decoding follow similar steps as 

Algorithmic From a given message vector m S [g]"“”, we first define a vector w = (0^,111). Then, we search a vector z 
such that y = w -b z • H masks all the partially stuck-at-1 cells. 

First, assume that RRE(H) can mask any u partially stuck-at-1 cells and let us show that then also H can mask any u 
partially stuck-at-1 cells. By assumption, there is a vector z = (zq, Zi,..., z^-i) such that y = w -f z • RRE(H) masks all 
the partially stuck-at-1 cells. Since H = T • RRE(H), for some k x k full-rank matrix T, the vector z = z • masks the 
same stuck-at cells when multiplied by H since z • H = z • = z • RRE(H). 

Second, we prove that RRE(H) can mask any u partially stuck-at-1 cells. To simplify notations, assume w.l.o.g. that each 
“block” of RRE(H(“)) has length exactly g — 1, if is shorter it is clear that the principle also works. Similar to the proof of 
Theorem]^ there is (at least) one value zq G Fg such that 

^0 ■ ^0,z ^-‘Wi, Vi e [q - 1], (4) 

since 0 consists of (at most) g — 1 constraints and there are g possible values for zg. Hence, (zg, zi,..., z^-i) ■ RRE(H*^“^) 
will mask the first g — 1 partially stuck-at-1 cells for any zi,..., z^-i since Wi 4- zg ■ Hg i 7^ 0, for alH = 0,..., g — 2. 
Similarly, there is (at least) one value zi G Fg such that 

-^1 ■ -Hi.* ^ -(Wi 4- Zg ■ Hg^i), ViG[q- 1, 2g - 3], 

and (zg, Zi,..., x^-i) • RRE(H(“)) will mask the second g — 1 partially stuck-at-1 cells for any Z2 ,..., Zk_i. This principle 
can be continued for each block of g — 1 cells and clearly, column permutations of RRE(H(“)) pose no problem on this 
strategy. 



In contrast to Theorem it is not clear if a similar statement as Theorem |7] also holds if g is not a prime power. 


Example 4 Based on Theorem the following k x n matrix, where k = 
stuck-at-1 cells over Fg.' 



9-1 



1 "^^^], can clearly mask up to u 


0 





< 9-1 


n partially 


The redundancy of this code for masking any u < n stuck-at-one cells is r = k = Thus, for q > n 1, this provides 

codes for masking up to u = n partially stuck-at-1 cells with redundancy r = 1. However, for u = n partially stuck-at-1 cells, 
we can always use the trivial construction from Section which outperforms the previous matrix for all g > 2. 


’Notice that RRE(HU)) can have less than k rows. 
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The following theorem shows a construction of u-PSMCs based on the parity-check matrix of linear codes. The proof uses 
Theorem [T] 


Theorem 8 (Construction II) Let u < q d — 3, u < n, k < n, and let H be a systematic (n — k) x n parity-check matrix 
of an [n, k, d]q code. Then, there exists a u-PSMC over of length n and redundancy r = n — k. 

Proof: Since H is the parity-check matrix of an [n, k, d]q code, for i > d — 1, any {n — k) x £ submatrix of H has rank 
at least d — 1 and contains no all-zero column. 

Let us consider the reduced row echelon (RRE) of any u columns of H. If u < d — 1, it is a square u x u matrix of rank 
u and a special case of ([^ with exactly one element in each “block”. Else, it has at least d — 1 rows and u columns of the 
following form: 

/I o 

1 o 
1 

0 

<u—d-\-l 


O O 

o o 
o o 

o o 
o o 


■ °\ 
. o 

. o 

. o 


(5) 


where o is some element from F^. The matrix H contains no all-zero columns, and thus its RRE contains no all-zero columns. 
This holds since RRE(H) = T • H for some full-rank matrix T and therefore, for some column vector (which denotes 
an arbitrary column of H), the column vector = T • (the corresponding column of RRE(H)) is all-zero if and only if 

b = 0. 

Hence, each of the (at most) u — d-\-\ rightmost columns in (|^ has at least one non-zero element. Eor any of these u — d-\-l 
columns, its lowermost non-zero symbol determines to which of the first d — 1 columns it will be associated. Hence, in the 
worst case, there is one such set of columns of size u — d-\-2 (the rightmost u — d-\-l columns and one of the leftmost d — 1 
columns). Thus, for u — d + 2<q-l, ^ is a special case of ([^. According to Theorem]^ we can therefore mask any u 
partially stuck-at-1 cells with this matrix and the redundancy is r = n — k. 

Algorithm 1^ shows the encoding procedure for this u-PSMC. Eor simplicity, a systematic {n — k) x n parity-check matrix 
H of the [n, k, d]q code is used. 


Algorithm 7. ENCODlNG-Il(m; ■ ■ ■, fu-i) 

Input: • message: m = {mo,mi, ... ,mk-i) £ [9]^ 

• positions of partially stuck-at-1 cells: 

{fo,4>i, ■ ■ ■, fu-i} ^ H 

1 w = {wo,wi,.. .,w„-i) ^ {On-k,mo,mi,. ..mk-i) 

2 Find z = {zq, Zi,..., Zn-k-i) as explained in the proof of Theoremj^ 

3 y w -f z ■ H 

Output: vector y with > 1 , Vi £ [u] 


The decoding is shown in Algorithm Both algorithms work similarly as Algorithms and but the restriction on the 
error-correcting code [n,k,d]q is weaker and therefore our u-PSMC has a smaller redundancy than the u-SMC. 


Algorithm 8. DECODING-Il(y) 

Input: • stored vector: y = 

= {yo,yi, ■ ■ ■ ,dn-i) £ M" 

1 z ^ {yo,yi, ■ ■ ■ ,dn-fc-i) 


2 w = {wo,wi, ■ ■ ■ ,w„-i) £- 

- y - z H 

3 m i {Wn — k^ ■ 5 

Wn-l) 

Output: message vector fn 

e[q]’^ 


Notice that for q = 2, a PSMC is just an SMC and the construction from Theorem]^ is equivalent to the one from Theorem 
Theorem leads to the following corollaries. 
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Corollary 1 Ifq > 2 is a prime power, then for all u < n, there exists a u-PSMC with redundancy r = max{l, pq (n, m — g + 3)} 
and therefore Vq (n, u, 1) < max{l, pq (n,u — q + 3)}. 

Corollary 2 (Construction II for u = q) If q > 2 is a prime power, then for all u = q < n, there exists a q-PSMC with 
redundancy r = pq (n, 3) and therefore Vq (n, q, 1) < pq (n, 3). 

Theorem shows that in many cases, we can decrease the redundancy by several g-ary symbols compared to SMCs. More 
specifically, according to Theorem in order to construct codes which correct u = q stuck-at cells, one needs to use a linear 
code with minimum distance u + 1, while according to Theorem for u = g partially stuck-at-1 cells, it is enough to use a 
linear code with minimum distance 3. The next example demonstrates that in many cases, this improvement is quite large. 

Example 5 Let u = q = b and n = 30. To mask u partially stuck-at-1 cells, we use the parity-check matrix of a [30, 27, 3]5 
code, which is the code of largest cardinality over F5 for n = 30 and d = 3 and thus its redundancy is r = 3 (see &■ 

To compare with SMCs, we need a code with minimum distance d = Q (compare Theorem^. The best known one according 
to has parameters [30, 22, 6)5 so its redundancy is r = 8. The trivial construction from the upper bound requires redundancy 
4.16. Therefore, we improve upon both constructions. 

However, note that it is still far from the lower bounds from (which is 0.69j and from Theorem^(which is l.llj. 

Another application of Theorem (and Corollary uses the parity-check matrix of the ternary Hamming code with 
parameters [n = ^ , n — r, 3)3 to obtain a 3-PSMC. The redundancy of this construction is r = log3(2n + 1). 

The following example shows how to use the same Hamming code, but double the code length and thus reduce the redundancy. 


Example 6 Let u = q = 3, and n = 8. We will show how to encode 6 ternary symbols using the matrix 


A 1 0 0 1 1 1 l\ 

0 1 1 1 1 2 2y • 


Any two columns 0/( 0112 ) linearly independent (it is the parity-check matrix of the [4, 2, 3)3 Hamming code), and 
therefore, any submatrix of H, which consists of three columns, has rank two and its RRE is of the form stated in 0 - 

Let m = (mg, Wi, m2, m3, TO4, ms) = ( 1 ,0, 2, 0,1,2) be the message and assume that the cells at positions 0,2,4 are 
partially stuck-at-1. We first set the memory state to be w = (0, 0, mg, mi, m2, m3, m4, mg) = (0, 0,1, 0,2,0,1, 2). Similar 
to the construction in Theorem^ we seek to find a length-2 ternary vector z = (zg, Zi) such that the vector y = w + z • H 
masks the three partially stuck-at-1 cells. Hence, we can choose z = ( 1 ,1) and thus, y = (1, 1 , 2, 1 ,1,2, 1 , 2) masks the three 
partially stuck-at-1 cells. It is possible to show that this property holds for any three partially stuck-at-1 cells and any message 
vector of length 6. 

This provides a code of length n = 8 and redundancy r = 2 for masking any u = 3 partially stuck-at-1 cells. The first part 
of the upper bound from 0 uses the trivial construction and gives 2.95. The second part of the upper bound is p 4 ( 8 ,4) = 4 
(compare l^) and thus, our construction requires less redundancy. The lower bound on the redundancy from 0 is 1.107, and 
the one from Theorem^is 1.161. 


Example is not a special case of Theorem The principle from Example works for rt = 3 and arbitrary g with the 
corresponding g-ary Hamming code. Unfortunately, it is not clear how to generalize it to arbitrary values of u or how to find 
other non-trivial matrices which fulfill the requirements of Theorem 


VI. Construction Using Binary Codes for Partially Stuck-at Level s = 1 Cells 

In this section, we describe a construction of m-PSMCs for masking u partially stuck-at-1 cells by means of binary SMCs. 
This construction works for any it; however, for u < q, the constructions from the previous sections achieve smaller redundancy, 
therefore and unless stated otherwise, we assume in this section that n > u > q. 

Eor a vector w G [g]" and a set (7 C [n], the notation wj/ denotes the subvector of w of length \U\ which consists of the 
positions in U. Let U contain the locations of the u partially stuck-at-1 cells, and let a vector w G [g]" be given, then our 
construction of PSMCs has two main parts: 

1) Find z G [g] such that the number of zeros and (g — l)s is minimized in the vector 

= (w-f Z • l„+i); 7 , 

and denote this value by u. 

2) Use a binary u-SMC to mask these u stuck-at cells. 

This idea provides the following theorem. 
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Theorem 9 (Construction III Using Binary Codes) Let n, q > A and u < n be positive integers and let u = [2u/gJ. 
Assume that C is an [n, k,d > u + i ]2 binary u-SMC with encoder E and decoder D given by Theorem Then, there exists 
a u-PSMC over [g] of length (n + 1) and redundancy 

r=^n-k-l)\og^[j^^+2. 

Proof: We will give the explicit algorithms for encoding and decoding. We assume that H is a systematic {n — k) x n 
parity-check matrix of the code C and we refer to Algorithms and as the encoder £ and decoder V of the code C, 
respectively. 

Let us start with the encoding algorithm for the it-PSMC. 


Algorithm 9. ENCODlNG-IIl(m; m'; {/) 

Input: • messages: m = e [g]^ and 

m' = e [[9/2]]"“''“^ 

• positions of partially stuck-at-1 cells: 

U = {fo, fi,- - ■, fu-i} ^ [n -f 1] 

1 w = (u;o,?ui,... ,Wn) ^ ... ,mfc_i,0) 

2 Find z e [g] such that the vector has at most u zeros and 

(g — l)s, where = (w -f z • In+i) mod g. Let U be the set of 
these positions. 

3 If 2 : > 0 then Wn'^ <— z, else <— g — 2 

4 Let V = (vq, Vi, , Vn-i) G [2]" be such that <— 1 if = g — 1, 

else Vi <— 0 

5 Apply Algorithm^ c' ^ £((vn-k,Vn-k+i, ■ ■ • ,Un-i); U; 1„) 
c ^ (c' 0) 

6 m ^ (2m'g, 2m[,..., 2 m'^_^^_ 2 , Ok+ 2 ) G [g]"+^ 

7 y -f c + rh) mod g 

Output: vector y G [g]”'*'^ with > 1, Vi G [u] 


First, we show that in Step 2 of Algorithm]^ there exists 2; G [g] such that the vector (w(^))(7 has at most u zeros and 
(g — l)s, where = (w -f z • 1) mod g. The value u is equivalent to the minimum number of cells in any two (cyclically) 
consecutive levels in w. That is, let us denote Vi = |{j : Wj = i,j G {i^O; ■ ■ • i for * G [?]• Then, we seek to 

minimize the value of 

Vi ~\~ mod qi 

where i G [g]. Since X]i=o mod q) = 2u, according to the pigeonhole principle, there exists an integer z G [g] such 

that Vz + Vf^z+i) mod q < L^tt/gJ = u. Therefore, the vector has at most u zeros and (g — l)s, and the set of these 

positions is denoted by U. We write the value of z in the last cell and if z = 0, we write Wn = q — A which is necessary in 
the event where the last cell is partially stuck-at-1. 

Next, we treat the u cells of of value 0 or g — 1 as binary stuck-at cells since adding 0 or 1 to the other u — u cells 
still masks those partially £tuck-at-l cells as they will not reach level 0. Therefore, according to Theorem [T] we can use the 
encoder of £ of the code C as done in Steps 4 and 5. The hrst part of Step 5 is a call of Algorithm In order to do so, we 
first generate a length-n binary vector v where its value is 1 if and only if the corresponding cell has value g — 1. Then, we 
require that the u cells will be stuck-at level 1. This will guarantee that the output c has value 1 if the corresponding partially 
stuck-at cell was in level 0 and its value is 0 if the corresponding cell was in level g — 1. We note that here we took only the 
last n — k indices of the vector v as this is the form of the input vector in Algorithm [T] while the vector v corresponds to the 
vector w in Algorithm 

The first n — k cells contain so far only binary values, thus, we use the first n — k — 1 cells to write another symbol with [g/2j 
values in each cell, as done in Steps 6 and 7. The last cell in this group of n — k cells remains to store only a binary value, 
which is necessary to determine the value of z in the decoding algorithm. 

To complete the proof, we present the decoding algorithm. 
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Algorithm 10. DECODING-Ill(y) 

Input : • stored vector: y = (yo, 2 / 1 , • • ■, J/n) £ 

1 If [yn-k-i - Vn) mod g < 1 then ? ^ i/„, else ? 0 

2 y 2 - y - z • l„+i 

3 m' ^ (Lyo/2j , Lyo/2j ,..., [yn-k-2/2\) 

4 t/- (yo - 2m'g, y„-k -2 - 2 m^_^_ 2 , yn-k-i) mod g 

5 c' /— t H 

6 m ^ .. .,yu-i - c'n-i) mod g 

Output: message vectors in £ [g]* and m' £ [L 9 / 2 J]" ^ ^ 


In Step I, we first determine the value of z. Note that if z ^ 0 then yn-k = Vn = z or t/n-fc = {Vn + 1 ) mod q and in either 
case the condition in this step holds. In case z = 0 then = g — 2 and yn-k = 0 or yn-k = 1 so (j/„-fc-i — yn) mod g > 2 
(since g > 4). Therefore, we conclude that z = z. 

In Step 3, we determine the value of the second message m'. Since z = z, we get that m' = m'. In Steps 4 and 5, we 
follow Algorithm 1^ in order to decode the vector c' and get that c' = c'. Lastly, in Step 5 we retrieve the first message vector 
and get m = m. 

The size of the message we store in this code is M = g^ • [(g/2)J"“^“^ and the redundancy of this w-PSMC is 

r = n + 1 - log, M = n + 1- log,(g'= • [g/2j”-^-i) 

= n-k + l-{n-k-l)- log,([g/2j) 

= (n-t-l)log,(^)+2. 

■ 

The following examples shows the complete encoding and decoding processes described in Theorem 


Example 7 Let g = 4, n = 15, fc = 11, u = 5 and U = {1,4,8,12,15} C [16] be the set of partially stuck-at-1 positions. 
Then, u = [2u/gJ = 2 and we can use the [15,11,3]2 code C as the binary 2-SMC. The following matrix is a systematic 
parity-check matrix of C: 

/lOOOOOOOOllllllX 
iLr — ( 010000111000111 1 
1 001011011011001 ■ 

\0 00101101101011 / 

Let m = (0, 3, 2,1, 2, 2, 3,1,3, 2, 2) and m' = (1, 0,1). 

Let us first show the steps of the encoding algorithm. With z = 1 in Step 2, we have in the different steps of Algorithm 
(the partially stuck-at-1 positions are underlined): 


Step 1: w = (0,0,0, 0, 0,3,2,1,2, 2,3,1, 3, 2, 2,0) 

Steps 2&3: = (1,1, 1,1,1, 0,3,2, 3, 3, 0,2,0, 3, 3, 1) 

Therefore, = (1,1, 3,0,1) has two 0i/3i which equals u. Further, we obtain: 

Step 4: V = (0,0, 0, 0,0,0,1, 0,1,1,0,0, 0,1,1) 

Step 5: c' = (1,0,0,0) •H = 

= (1,0,0,0,0,0,0,0,0,1,1,1,1,1,1) 
d= (1,0,0,0,0,0,0,0,0,1,1,1,1,1,1,0) 
Step 6: m = (2,0, 2, 0,0,0,0, 0, 0,0,0,0, 0, 0,0,0) 

Step 7: y = (0,1, 3,1,1,0,3, 2, 3,0,1,3,1, 0,0,1) 


Clearly, the partially stuck-at-1 positions are masked in the vector y. 
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Let us now show the decoding process, i.e.. Algorithm \10\ 

Step 1: ?/3-2/15 = 0 z=l 

Step 2: y = (3,0, 2, 0, 0,3,2,1, 2, 3,0, 2,0, 3, 3,0) 

Step 3: m' = (L3/2j,0,L2/2j) = (1,0,1) 

Step 4: t = (3 - 2, 0 - 0, 2 - 2,0) = (1, 0, 0,0) 

Step 5: ? = t • H = (1,0, 0, 0,0,0, 0, 0, 0,1,1,1,1,1,1) 

Step 6: m= (0,3, 2,1, 2,2, 3,1, 3, 2,2). 

We have therefore successfully recovered the messages m and m' and the redundancy to mask these five partially stuck-at-1 
cells is r = 3.5 q-ary cells. Construction 11 from Corollary^requires redundancy p 4 (16,4) = 4. 

The lower bound from Q gives 1.037 and the lower bound from Theorem 1.26. 

Ai a comparison, to mask u = 5 usual stuck-at cells in a block of 16 cells, we need a quaternary code of length n = 16 
and distance d > m + 1 = 6. The largest such code is a [16, 9,6)4 code with 7 redundancy symbols. The trivial construction 
from Theorem^needs redundancy 3.11. For this example, the new construction is thus worse than the trivial one. However, 
for larger n, the influence of the +2 in the redundancy diminishes and our construction outperforms the trivial one (see 
Example j^, but the principle of the construction is easier to show with short vectors. 

Example 8 Let q = A, n = 63, k = 57 and u = 5. Then, the required redundancy for Construction II from Corollary^is 

it is r = 4.5. This improves significantly upon the upper bounds from 
^needs redundancy 13.1 and pi (64,6) = 13. 


P4 (64,4) = 6 and for Construction III from Theorem^ 
Theorem since the trivial construction from Theorem 


The next corollary summarizes this upper bound on the redundancy for n cells. 
Corollary 3 For all A < q < u < n we have that 

Tq {n, u, 1 ) < (p2 {n - 1 , + 1) -1) • logg 


Ld/2J 


2 . 


Therefore, if we use a binary [n = 2’’® — l,n — r^j, 3]2 Hamming code as a m-SMC with u = 2, then u < q + 
has to hold. For even q, we therefore have u < q + q/2 — 1. Then, the required redundancy is r = (th — 1) log,j(2) + 2 = 
(log2(n + 1) - 1) • log^(2) + 2. 

Note that for u —t n and for large q, the trivial construction from Section [H] is quite good. Construction III outperforms the 
trivial construction if u > q and u. 


VII. Generalization of the Constructions to Arbitrary Partially Stuck-at Levels 

The main goal of this section is to consider the generalized model of partially stuck-at cells as in Definition This model 
is applicable in particular for non-volatile memories where the different cells might be partially stuck-at different levels. 

Let U = {fio, fi,..., fiu-i} be the set of locations of the partially stuck-at cells where the i-th cell, for i G {fio, ■ ■ ■, fiu-i}, 
is partially stuck-at level s^. We denote by Ui, i G [g], the number of cells which are partially stuck-at level i (thus, X)i=i 
and by Ui C [n], Vi G [g], the set of positions which are partially stuck-at-L Note that some values of Ui might be zero and 
thus the corresponding sets Ui are the empty set. 


In the sequel of this section, we generalize the constructions from Sections |lV)|V]and|Vl]to the generalized model of partially 
stuck-at-s cells, where s = (sojSi, 


,Su_i) G [l,g — 1]“. We only give the main theorems without showing the explicit 
decoding algorithms and mostly without examples since these results are a direct consequence of the previous sections. 


A. Generalization of Construction I 

Construction I from Theorem [^ (including its improvement from Theorem]^ generalizes as follows. 

Theorem 10 (Generalized Construction I) If Si < q and u < n, then for all n, there exists a {u,s)-PSMC, where 
s = (sq, Si) ■ • ■, s„_i) G [0, g — 1]“, over [g] of length n and redundancy 

q 


r = 1 - log 


E U—1 . 

i=o s* + 1 


Proof: The proof is a generalization of the proofs of Theorem]^ and Theorem]^ Let m S [g]" ^ be the message vector, 
define w = (0 m) and let y = w -f z • 1„ be the vector that we will store. We have to find z such that y^j,. = (w^. + z) ^ [s^]. 
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Vi S ju]. Each partially stuck-at-Si cell excludes at most Si possible values for z, in total the u cells therefore exclude at most 
EitTo Si values and if < 9’ there is at least one value z G [g] such that y^. = + z) ^ [si], Vj G [u]. 

In particular, there is always a z G Si + 1] such that y^. = + z) ^ [s^], for all i G [u]. Therefore, we can save 

additional information in the redundancy cell and as a generalization of Theorem]^ the statement follows. ■ 

The encoding and decoding processes are analogous to Algorithms and and Algorithms and respectively. Unfor¬ 
tunately, we cannot claim (as in Theorem for Si = 1, Vi) that this construction is asymptotically optimal, since the lower 
bound on the redundancy in Theorem does not depend asymptotically on the value of s. For example, if Si = s, Vi, and 
{su + 1) I g, then the redundancy of Theorem 10 is r = logg{su -f 1), but the lower bound form Theoremapproaches only 
Tq (n,u, s) = log (u + 1) for n large enough. 


B. Generalization of Construction II 

In order to generalize Construction II from Theorem let us first generalize Theorem 

Theorem 11 Let q be a prime power and let a k x n matrix H = over be given. Let s = maxjg[„] s^. 

If the RRE of any nxu submatrix (denoted by has the following form (up to column permutations:) 


rre(h(“)) = 



(6) 


. . . o 
. . . o 
. . . o 


\ 


where • has to be a non-zero element from and o is any element from Fg, then, there exists a (u, s)-PSMC over [g] of 
length n and redundancy r = k. 


Proof: Follows from the proof of Theorem 11 with similar generalizations as in Theorem 10 


Notice that the largest Si restricts the size of the matrix and it is not clear how to consider the explicit values Si in this 
generalization and not only the maximum value. 

Based on Theorem El we can generalize Construction II as follows. 

Theorem 12 (Generalized Construction 11) Given s = (sq, si,..., s^-i) € [1, g— 1]“. Let s = maxig[„] Si, let u < \q/s\ + 
d — 3, u < n, k < n, and let H be a systematic (n — k) x n parity-check matrix of an [n, k, d]q code. Then, there exists a 
(u, s)-PSMC over F^ of length n and redundancy r = n — k. 


Proof: Similar to the proof of Theorem using Theorem 11 


Corollary 4 If q > 2 is a prime power, then for all u < n and s G [l,g — 1], there exists a {u, s)-PSMC with redundancy 
r = max{l, pq (n, u — \q/s\ + 3)} and therefore Vq (n, u, s) < max{l, pq (n, u — \q/s\ + 3)}. 


C. Generalization of Construction III 

In the following, we want to generalize Construction III from Theorem]^ 

In the first step, we suggest a generalization to the case where all partially stuck-at cells are stuck at the same level s, for 
some 1 < s < g — 1. For this purpose, we use a Q-ary code, where Q > s -f 1 is a prime power, and the principle consists of 
the following two steps: 

1) Find z G [g] such that the number of the values contained in the set S' = {g — Q + 1,..., g — 1, 0,..., s — 1} of size 

Q + s — 1 is minimized in = (w -h z ■ ln)i7- 

Denote the number of values from S in by u. 

2) Use a Q-ary u-SMC to mask these u stuck cells. 

This leads to the following theorem. 

Theorem 13 (Generalized Construction 111 for Si = s) Let n, q > A, u be positive integers, let s G [1, g — 1], and let 
Q > s 1 be a prime power. Denote 

~ _ {Q + s — l)u 

L d 
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Assume that C is an [n,k,d> u + 1]q Q-ary u-SMC with encoder £ and decoder T) given by Theoremj^ Then, there 
a (u, s)-PSMC over [g] of length (n + 1) and redundancy 


= {n — k — 1) logj 




2 . 


exists 


(7) 


Proof: Let S = {g — Q + 1,..., g — 1,0,..., s — 1} of cardinality Q -\- s — 1. As in the proof of Theorem we hrst 
show that there is some scalar z such that has at most u entries from S. The value u is equivalent to the minimum 

number of any Q + s — 1 consecutive values in wjj- Denote Vi = |{j : Wj = i,j S {^^O) • ■ •, <Pu-i}\, for all i G [g]. Hence, we 
want to minimize vt+j^odg, i £ [?]■ Since J2iZo Wi+jmod? = (<5 + s - l)u, there exists an integer i such 

that 't’i+jmodi/ < therefore, there is a z such that contains at most u = [ values 

from S. ' ' 

Second, we treat those u cells of which have values in S, like usual Q-ary stuck cells. Note that adding any value 

from the set [Q] to the other u — u cells still masks the partially stuck-at-s cells. Therefore, we can use an [n, k,d > u + 1]q 
code to mask these cells (see Theorem [^. 

As a generalization of Theorem we choose me [g]^ and m' e [ L^/QJ ]" ^ ^ '^he statement on the redundancy 
follows. ■ 


Note that if Q-fs — 1 > g, then u> u and instead of using Theorem 13 we should use a g-ary u-SMC or another construction. 

Let us now describe a method to generalize the construction from Theorem (respectively Theorem 13i to the case where 
the cells are partially stuck-at different levels, given by s = (sq, si, • ■ •, Su-i). We want to use a Q-ary SMC, where Q > 
maxi{si} + 1, to obtain an (u, s)-PSMC. Of course, one way is to dehne s = maxijsi} and to consider the cells as partially 


stuck-at-s cells and use Theorem 13 However, we can do better by rehning the “minimization step” as done in the following 
theorem. 


Theorem 14 (Generalized Construction III) Let n, q > 4 and u be positive integers. Let s = (sq, si,..., s^-i) £ [1, g — 1]“ 
be given and denote Ui — |{sj = £ [m]}|, Vi £ [g]. Then, u = Q — naciXi{si} -I- 1 he a prime power. 

Denote Ui = min{g, Q + i — 1}, Vi £ [g], and 

[ q 

Assume that C is an [n, k,d > u + 1]q Q-ary u-SMC with encoder £ and decoder D given by Theoremj^ Then, there exists 
a (u,s)-PSMC over [g] of length (n -I- 1) and redundancy 

. = („-fc-l)lo8,(j^)+2. (8) 

Proof: If a cell in Ui has a cell level in [l,g — 1], then this partially stuck-at cell is still masked after adding any value 
from [Q]. Thus, we want to hnd z £ [g] such that the partially stuck-at positions in the vector = (w -£ z • ln+i)ui 

contain as many values in [i, g — Q], Vi £ [1, g — 1], as possible. Equivalently, we want to minimize the number of values from 
[q] \[fq- Q] in (wV))j^., for all i e [l,g- 1 ]. 

In the sequel, we describe a way how accomplish this. We have 

O'* = IM \ [l g - Q] I = min{g, Q -f i - 1}, Vi £ [g], 

and generalizing Theorems |9] and [O] we dehne; 

= \{j ■ Wj =i,j £ Ui}\, ye £ [g], i £ [l,g- 1]. (9) 


We want to minimize (subject to f G [g]) 


H — -*-01 — -1 

EE 


V 


(^) 

£-\-j mod q ‘ 


2 = 1 j = 0 


We know that 


q—1 q—l (7i — l q—1 

EE E mod, = E"^* • 


i—Q i—l j=0 i—l 

Thus, by the pigeonhole principle, there exists an integer i G [g] such that 

E q—1 

i=i ■ c 


E E mod 9 < 

2 = 1 j=0 


def ~ 
= U. 
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Similar to Theorems and [Ts] we can treat these u partially stuck-at cells as Q-^^ry cells which are usually stuck-at. With a 
similar proof as in Theorerns|^ and 13 this leads to the statement. ■ 


Example 9 Let n = 31, q = 8, and s = (1 1 1 1 2 2 3). Hence, ui = 4, U2 = 2, its = 1 and u = 7. We choose <5 = 4 and 
we want to use a 4-ary SMC to construct a (u, s)-PSMC of length 32. 


The first approach is to consider all cells as partially stuck-at level s = maxi{si} = 3. Then, with Theorem 13 and <5 = 4, 


we have u = 5 and we need a code over F22 of length 31 and distance at least 6. The largest known such code is a [31, 23, 6)4 
code (see l^) and therefore, with Q. the required redundancy is 6.66. 

Let us now compare this to Theorem We denote CTi = 4, (72 = 5 and CT3 = 6 and therefore. 


u = 


4mi + 5u2 + 6m3 


= 4. 


We need a code over F22 of length 31 and distance at least u -I- 1 = 5. The largest such known code is a [31,24,6)4 code 
(see l^) and with the required redundancy is r = 6, i.e., compared to the approach of Theorem \13\ we have decreased 
the redundancy. 


The generalized Construction II from Theorem 12 needs redundancy ps (32, 7) = 10. Further, the upper bound from 


Theorem^ gives 7.01 and we also improve upon this bound. 


VIII. Codes for Cells with Unreachable Levels 

In flash memories, it might happen that certain levels cannot be reached or should not be programmed anymore since they 
are highly unreliable, see e.g. |j^. Finding codes that mask these cells can be seen as the dual problem to finding PSMCs. 
Namely, we want to And a code as follows. 

Definition 2 (Codes for Unreachable Levels) An {n,M)q {u,s)-unreachable-masking code ({u,s)-UMC) C is a coding 
scheme with encoder £ and decoder T). The input to the encoder £ is the set of locations {fo,..., fu-i} [n], the unreachable 
levels s = (sq, Si,..., Su-r) G [<7” 1]“ of some u < n cells and a message m € [M]. Its output is a vector £ [g]" which 
masks the values of the u cells with unreachable levels, i.e., 

and its decoded value is m, that is = m. 

The following theorem establishes a connection between PSMCs and UMCs. 

Theorem 15 Given a (m, s)-PSMC with s = (g—1 — sq,?— 1 — si,..., 9 —1 — s„_i) and redundancy r. Then, this code 
can be used as a {u,s)-UMC with s = (sg, Si,..., s„_i) and redundancy r. 

Proof: Assume we want to write a message into n memory cells where the levels at positions fi ,..., fu-i can be at 
most sqj Si, ■ • ■ 1 s„_i. We construct a (u, s)-PSMC with redundancy r for the levels s = (<7— 1 —sg, g—1 —Si,..., g—1 —s„_i). 
The output of this encoder is a vector y(”^) such that > <7 — 1 — s^, Vi G {fio, fi, ■ ■ ■, 

Therefore, the vector y(™) (q — 1 — y^\ q — 1 — y["‘\ ..., q — 1 — y^{) has the property that 

< g - 1 - (9 - 1 - Si) = Sj, Vie {(j)Q ,..., fu-i), 

and therefore, we write yl™) into the cells and have constructed a (u, s)-UMC with s = (sg, Si,..., s„_i) and redundancy r. 

■ 

The construction by Gabrys, Sala and Dolecek from |j^ is based on tensor product codes and can mask unreliable cells and 
correct additional random errors. To compare their construction to our results, we assume that no random errors occur (i.e., 
in their notation U = ^2 = 0). Then, their matrix iVg defines an [n, n, 0)4 code (in their notation, meaning it does not correct 
any error), 774 defines an [n, fc4, 0,£]2 code (meaning it is a 7-SMC which cannot correct additional random errors). Therefore, 
(74 > 7 + 1, see e.g., Q and due to the Singleton bound k 4 < n — d 4 -£ 1 = n — £. The construction from ||^ p. 1492] yields 
a code for masking the unreliable cells of length 3n and dimension 2^3 -1-74 < 3n — £. Thus, their required redundancy is 
r > £, which is the same as the one for a 7-SMC and thus, their construction does not give any improvement compared to 
0. As shown in the previous sections and in Theorem [T^ our constructions therefore improve on both, 0 and |[^, when 
masking memory cells with unreachable levels. 
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IX. The Capacity of the Partially Stuck-at Cell Channel 


In this section, we study the setup of partially stuck-at cells from the capacity point of view. For fixed integers q > 1 
and 0 < s < q, we consider the storage channel in which a cell can be partially stuck-at level s with probability p. This 
channel model is an example of a discrete memoryless memory cell which was studied by Heegard and El Gamal in pO) . 
In the partially stuck-at cell model, we assume that a cell is partially stuck-at level s with some probability p. If a letter 
x G X = {0,1,..., g — 1} is stored in a cell, then the letter y G Y = {0,1,..., 9 — 1} is retrieved where y = max{x, s} with 
probability p. 

If both, the encoder and decoder, know the state of the memory, i.e. the locations and levels of the partially stuck-at cells, 
then the capacity of this channel is 


Cq{p,s) = 1 - p + p \ ogg{q - s) 


1 -plogg 



( 10 ) 


To see this, notice that the lower bound on the redundancy from Theorem holds also in this case as this is the number of 
all different memory states that can be programmed. The capacity is achievable since both the encoder and decoder know the 
locations of the partially stuck-at memory cells and thus can use all programmable memory states. Furthermore, according 
to |T§, the capacity of any discrete memoryless memory cell channel in the case where only the encoder knows the memory 
state is the same as the one where both the encoder and decoder know the memory state. Thus, we conclude that ( [T0| ) is the 
capacity of the model studied in this work. 

In the following, we want to analyze how close our constructions are to the capacity. Let us first consider the case s = 1. 
The construction based on binary codes from Section |Vl] can mask u = pn partially stuck-at-1 memory cells if there exists an 
[n,k,d ]2 binary code that can mask u = [2u/qJ = [2pn/q\ binary usual stuck-at cells (which is the case if d > u-f 1, see 
Theorem [T]). Assume there exists a family of capacity-achieving linear binary codes with these properties, then we can use 
this family of codes in order to construct a family of PSMCs. Asymptotically, for large n and any q, the maximum achievable 
code rate of the construction from Theorem approaches the value 


Rq{pA) 


n — r 2p 

- = 1-log 

n q 



Similarly, for arbitrary s (for simplicity assume that Q = s -I- 1 is a power of a prime), we obtain a family of PSMCs whose 
maximum achievable rate approaches the value 


QiSp 

Rq{p,s) = 1-log 

9 


q 


lq/is + i)\. 

Finally, we conclude that the difference between the capacity and the redundancy of this construction is given by 


Cq{p,s) - Rq{p, S) 

= P ■ f V 


lq/is + i)\ 


-log. 


q-s 


='a(9.s) 


where we call A{q, s) the difference coefficient. 

Table 1^ shows the values of the difference coefficient A{q,s) for different values of q and s. 


( 11 ) 


Table I 

The difference coefficient A { q , s) for different values of q and s, where 0 < S < q where S -|- 1 is a prime power. 



s = 1 

s = 2 

s = 3 

S = 4: 

s = 6 

s = 7 

1 

= 2 

0 






q 

= 3 

0.29 

0.33 





g 

= 4 

0.042 

0.5 

0.5 




g 

= 5 

0.089 

0.48 

0.63 

0.6 



g 

= 6 

0.027 

0.18 

0.61 

0.72 



g 

= 7 

0.045 

0.19 

0.57 

0.71 

0.71 


g 

= 8 

0.019 

0.19 

0.27 

0.67 

0.83 

0.75 

g 

= 11 

0.020 

0.11 

0.25 

0.33 

0.76 

0.85 

g 

= 13 

0.015 

0.076 

0.16 

0.31 

0.68 

0.77 

g 

= 16 

0.0079 

0.057 

0.11 

0.19 

0.39 

0.45 

g 

= 21 

0.0072 

0.036 

0.084 

0.14 

0.25 

0.38 

g 

= 32 

0.0033 

0.023 

0.047 

0.082 

0.17 

0.19 


In the same way. Figure illustrates the difference coefficient for some values of q and s. We see that the difference 
coefficient tends to zero for q large enough. The “plateaus” in the plots occur due to the floor operation in 0- A similar 


analysis can be done for the {u, s)-PSMC construction from Theorem 14 
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Figure 1. The difference coefficient s) for different values of q and s. 


For the special case s = 1 and when q is large enough, we neglect the floor operation and we can use the approximation 
ln((7) — ln(g — 1) « 1/q and obtain 


Cq{pA) 


Rq{p,^) = 

21 ogg(2) 

q 

21 n(2) 
q\n{q) 


-log, 

1 

gln(g) 



( 12 ) 


Thus, we can evaluate how close the code rate from Theorems and come to the capacity from ( [Tol l. Further, shows 
that asymptotically, the coefficient A((7,1) approaches zero when q increases. In the same way, for fixed s, the coefficient 
A{q,s) approaches 0 with increasing q. 

We note that the trivial construction from Theorem]^ in which only the levels s,... ,q— 1 are used, can also be used to 
mask any number of cells which are partially stuck-at-s. The rate of this construction is log^((7— s), and it is greater than the 
value of Rq{p, s), when q is a multiple of s + 1, if 


\ogg{q-s) > 1 


2sp 

q 


logg(s + 1), 


or 


P > 


q^ 

2s 


logs+l 



For example, for s = 1 we get that this threshold equals 


log 


.9-1. 

and for q large enough, this value approaches 1/(2 In 2) « 0.7213. 

We conclude that the maximum achievable rates, denoted by s), according to the constructions from Theorems 

andfTS] when q is a multiple of s + 1, is given by 


R^’^^P,s) = 


1-^-flog^is + l) 
\ogJq-s) 


if P < ^ log,+i 
else 


(*) 


In FiguresSand^ we plot the graphs of the capacity C{p, s) and the maximum achievable rates R'^^^{p, s) for q = 8, s = 1, 3 
and q = IT/s = 1, 3, 5. 

Notice that asymptotically, both an SMC and Construction II have rate R = 1— p and are therefore worse than s). 












20 



Figure 2. Capacity Cq{p, s) and maximum achievable rate s) for q = 8. 



Figure 3. Capacity Cq{p, s) and maximum achievable rate s) for q = 12. 


X. Conclusion 

In this paper, we have considered codes for masking partially stuck-at memory cells. After defining the defect model, we have 
derived lower and upper bounds on the minimum redundancy which is required to mask partially stuck-at cells in multilevel 
memories. We have presented three constructions of partially stuck-at masking codes (PSMCs). The first one masks any u < q 
partially stuck-at cells, where q is the number of cell levels, and requires less than one redundancy symbol. When the cells 
are partially stuck-at level 1 (i.e., s = 1), this construction is asymptotically optimal. The second construction is based on the 
parity-check matrix of an error-correcting code and works well for u> q (where g is a prime power). The last construction is 
based on using a binary error-correcting code and can be applied for any u and q. The three constructions were first derived 
for s = 1 and then generalized to arbitrary stuck levels. We have further shown how these PSMCs can be applied for cells 
with unreachable levels (which can be seen as the dual problem to partially stuck-at cells) and that they outperform known 
code constructions for this model. Further, we have considered the capacity of the partially stuck-at channel and have analyzed 
the gap between the capacity and the achieved code rate. For s = 1, we achieve the capacity asymptotically. 

The following table for s = 1 provides an overview of our constructions and their required redundancies. Recall that pg (n, d) 
denotes the smallest redundancy of a linear error-correcting code of length n and minimum Hamming distance d over F^. 
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Upper bound on Vq (n, u, 1) 

u < q 

1 logg (Theorem 4 


u> q 

Pq {n,u — q + 3) (Corollary 


any u, q 

(p2 (n-l,LfJ+l)-l) 

(Theorem 

(l9/2j) + 2 


Similarly, the following table gives an overview of the constructions for arbitrary partially stuck-at levels, given by a vector 
s = (so, Si, ■ ■ ■, s„_i) G [1, g - 1]“. 


Upper bound on r, (n, u, s) 


U—1 

E s* < 9 

2=0 


l-log? (Theorem 


lOi 





r 1 

Pq [n, U - 

Q 

1 maxi Si 1 

maxi Si 


3) (Corollary 


4i 


any u,q 


{PQ ( 


n — 1, 




+ 1-1 


(i;^) +2, 


where Q > maxijsi} + 1 is a prime 
power and ai = min{g, Q + i — 1}, 
Vi G [g]. (Theorem 141 


Thus, we have provided codes for masking partially stuck-at cells for any set of parameters and have shown that the required 
redundancy significantly decreases compared to SMCs and to a trivial construction. 
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